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Abstract. We present a new bound on ^ = max„ \apqr{n)\, where Upgrin) are the coefficients of a 
ternary cyclotomic polynomial <^pqr{x) = n(fc,p<,r)=i; o<fe<p9r(2^ - ^pgr) with p, g, r prime, p < q,r, 
q ^ r. We also prove that |apgr("-) — CLpgrin ^ 1)1 ^ f • 



1. Introduction 

Let 

(fc,pgr)=l; 0<k<pqr n 

be a ternary cyclotomic polynomial with p < q,r prime and pairwise different. The coefficients of ^pqr 
have been a subject of studies for over a century. The main problem was to estimate the following 



^ ' parameters: 



> 

(N 
O 



= ma.xapqr{n); v4_ = minapgr('^); A = max{y4+, —A^}. (1) 

n n 

The first bound on A was given by Bang [2J who showed that 

A^p-1. 

This bound was improved later by Beiter [3J. She proved that 

A^p- 

Beiter also came up with a following conjecture: 



p 

L4. 



g Conjecture 1. A ^ 2±i, 



> 



now known to be false. Gallot and Moree [5j found infinitely many pairs of primes q, r for every 5 > 
and p sufficiently large, such that 

A> C^-e]p, 



^3 

It updates Belter's Conjecture into the following form: 
Conjecture 2. A ^ |p. 

This is still an open problem. 

In this paper we derive a new bounds on ternary cyclotomic coefficients, which depend on the 
inverses of q and r modulo p (denoted here by q' and r' respectively). The main result of this paper 
are the following theorems: 

Theorem 1. Let A+ and A^ be defined as in (Qjj. Then 

A+ ^ mm{2a + p,p- f3}; -A_ ^ mm{p + 2a - f3}, 
where a = min{g', r',p — q',p — r'} and aPqr = 1 {mod p), < P < p. 
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Theorem 2. Put (3* = mm{/3,p — /?}. Then 

A^mm{2a + P*,p- P*}. (2) 
Theorem [2] improves the bound on A obtained by Bachman [1]: 

A^min|^-^ + a,p-/3*l- (3) 



One can deduce by reductio ad absurdum, that the bound ([2]) is at least as strong as ([3]). It is also 
easy to check, that the bound ([2]) is sharply stronger than ([3]) if and only if a + /?* < what gives 
exactly — 3)(p — 5) of all the {p — 1)^ pairs (x, y) of residue classes q and r modulo p. 

As an application, we prove a density result showing that Conjecture |2] holds for at least P of all the 
ternary cyclotomic polynomials and prove that average A of all the ternary cyclotomic polynomials 
with the smallest prime factor of n equal to p does not exceed (according to Bachman's Theorem 
these values was | and + o(l) respectively). 

We also reveal for every prime p > 3 some new classes of ternary cyclotomic polynomials ^pgr for 
which the set of coefficients is very small. For example A ^ 3 if = ±l(mod p) and r = ±l(mod p). 

Our method also leads to a simpler proof of the so called jump one ability of the ternary cyclotomic 
coefficients due to Gallot and Moree [6|. It was shown by the present author independently of Gallot 
and Moree. 

Theorem 3. = ^Inez 

ternary cyclotomic polynomial, then 
\apqr{n) - apqrin - 1)1 ^ 1 

for every n E'L. 

2. The numbers 

We define special numbers, which are the key tools in the proof of Theorem [1] and [3l Throughout 
the paper we assume that /c G Z, fix p, q, r and denote by a^, bk, Ck the unique integers such that 
^ ttfc < ^ 6fc < g, ^ Cfc < r and 

k = a^qr + burp + c^pq (mod pqr). 

Let 

^ _ Ok ^bk _^ Ck ^ 

pqr pqr 
Observe that Fk G {0, 1, 2} for —{qr + rp + pq) < k < pqr, since 

^ ttkqr + bkrp + Ckpq — k < {p — l)qr + {q — l)rp + (r — l)pq + qr + rp + pq = 3pqr. 

In the remainder of this section we establish the properities of the sequence Fk- 

Lemma 1. If Fk = then ^ [^\ . If Fk = 2 then ^ ^ fc+pg+^P j ^ 

Proof. The first implication is obvious. For the second one we note that 

k + 2pqr = akqr + bkrp + CkPq ^ a^gr + (g — l)rp + (r — l)pq, 
thus ttfcgr ^ k + rp + pq and finally ^ [" ^"'^^^^''^ ] ■ □ 
Lemma 2. Let p'^, p'^ be the inverses of p modulo q and r respectively. Then 

{-1, if Ok < r' and Ck < p'^\ 
1, if Ok ^ r' and Ck ^ pU 
0, otherwise. 

Analogous statement holds for Fk — Fk-r with Ck, r' , p'^ replaced by hk, q' , pL respectively. 
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Proof. Observe that ak-g = — r' (mod p), Ck-g = — p'^ (mod r) and b^^g = h^. Therefore 



r' - p, if Ofc < r'; 
r', if ttk ^ r'. 



and 



- r, if Cfc < p^; 
p;, if Ck ^ p^. 



Let [P] G {0, 1} be the logical value of an expression P. Then 

i'k — i'k-q — 1 1 



p 

r' ^ p[. 1 

p r pr 

1 - [ttfc < r'] - [Ck < p'r] ■ 



1 

pr 



[ttk < r'] - [Ck < Pr] 



□ 



Lemma 3. Let M = max{g',r'} and m = min{g',r'}. Then 



F, 



k—q 



Fk-r + Fj. 



k—q—r 



0, if ak < M + m — p; 

-1, if M + m — p ^ ttk < m; 

0, if m ^ ak < M; 

1, if M^ak<M + m; 
0, if M + m^at. 



This Lemma works also for any permutation of {p, q, r) with similarly defined M and m. 
Proof. Using the method similar to the proof of Lemma we obtain 

Fk - Fk-q - Fk-r + Fk-q-r = -[ofe < q] - [ofc < r'] + [ttfc < q' + r'] + [ak < q' + r' - p] 

= [ak < M + m - p] - [ak < m] - [uk < M] + [ak < M + m]. 

Now it is easy to verify the lemma, since M + m — p<m^M<M + m. 

Lemma 4. 

Fk ~l~ Fk—p—g ~\~ Fk—g—r ~\~ Fk—r—p Fk~p ~\~ Fk—g ~\~ Fk—r ~\~ Fk—p—q—r- 

Proof. By Lemma [3], the value of Fk — Fk-g — Fk-r + Fk-q-r depends only on k modulo p. Thus 

Fk Fk—g Fk-r ~\~ Fk—q—r Fk—p Fk—p—g Fk—r—p ~l~ Fk—p—g—r- 



□ 



□ 



3. Proof of Theorem [T] 

Bloom [1] described a relation between the ternary cyclotomic coefficients and the numbers k such 
that k = akqr + hkrp + Ckpq with a^, hk and Ck defined in the previous section. This equality holds if 
and only if = 0, so we can express his result in terms of Fk- 
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Lemma 5. Denote by Nfi{ti,t2, ■■■,ti) the number ofd's in the sequence {ti,t2, ■■■,ti) . Then 

n 

apqr{n) = ^ {No{Fk, Fk_g_r) - No{Fk-g, Fk-r)) 
k=n—p+l 
n 

= {N2{Fk,Fk_g_r)-N2{Fk-g,Fk-r)) 
k=n—p+l 

1 " 

= 2 5Z {NiiFk-g,Fk-r)- Ni{Fk,Fk-g-r)). 

k=n—p+l 

Proof. The first equality is due to Bloom [4]. Here we rewrite his proof which uses the formal series: 

^'^''^^^ ~ (1 -X){1- Xl^){l - X^P){1 - 



'l-x''){l-x''){l+x + ... + xP-^) J2 a;'""'+'"^+'^Mmod 



x^n 



Note that if k ^ deg($pgr) < pgr then there exists at most one triple (a, b, c) such that k = aqr + 
6r]9 + cpq. This equality holds if and only if = with a = ak, b = bk, c = Ck- Then 

n 

apqrin) = Yl {[Fk = 0] - [Fk-g = 0] ~ [Fk-r = 0] + [Fk-,-r = 0]) 
fc=n— p+1 
n 

= Yl {No{Fk,Fk-g^r)-No{Fk-g,Fk^r)). 
k=n—p+l 

Now in order to simplify the expressions we will use the following notations: 

-^0 -^o(-^n) Fn—li •••) -^n— Fn—q—r': Fn—q—r—li •••) -^n— g— r— p+l) i 

-^0 -^oi,Fn—qi F,^_q_iy -^n— p+l) Fn—ri -^n— r— li -^n— r— p+l)i 

and similarly A'']^, A'']", N2 , ■ We have just proved, that apqr{n) = Nq — Nq . Now by Lemma [3] 
we have 

n 

N^ + 2N+-N^-2N^ = Y {Fk - Fk-q - Fk-r + Fk^q-r) 

fc=n— p+1 

= min{M + m, p} — M + m — max{M + m — p,0} = 0. 

Moreover 

A^o+ + + A^2^ = + + = 2p. 
By simple arithmetical operations, these equalities lead to 



apqrin) = iV+ - AT- = - = l(iVr - iV+). 



□ 



Using the first equality of Lemma O we consider the 4-tuples {Fk, Fk-q, Fk-r, Fk^q^r) , where k G 
{n,n — 1, ...,n — p+1}, such that No{Fk, Fk-q-r) 7^ No{Fk-q, Fk-r)- Lemmas [2] and [3] will help us to 
exclude the existence of most of the 81 possible 4-tuples. 

If No{Fk, Fk-q, Fk-r, Fk^q-r) € {0, 4} then A^o(^n, Fn-q-r) = A^o(^n-g, -^n-r), SO wc are uot going to 
consider these cases. Also if No^Fk, Fk-q, Fk-r, Fk-q-r) = 2, then Nq^F^, F^-q-r) = A^o(^n-g, in-r) or 
\Fk — Fk-q — Fk-r + Fk-q-r\ ^ 2, what contradicts Lemma [31 therefore this case also does not need to 
be considered. 
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To describe the rest of possibilities we need to observe the following facts: 
If NqIF^, Fk_q, Fk-r-, Ffc^g_r) = 3 then by Lemma [2] the only non-zero entry here is equal to 1. 
If No{Fk, Fk-q, Fk-r, Fk-^q-r) = 1 then Fi = for some / G {k, k — q,k — r,k — q — r}. By Lemma [2] 
we have Fi±q = 1 and Fi±r = 1, where sign + or — depends on the chosen /. 
All these cases are described in the table below. 



Case No. 




Fk Fk—q F^—r ~\~ Fk—q—r 


No{Fn, Fn-q-r) — ^^{Fn-q-, Fn-r) 


1 


(0,0, 1,0), (0,1, 0,0), 


-1 


1 




(0,1, 1,1), (1,1, 1,0) 






2 


(0,0,0,1), (1,0,0,0), 


1 


-1 




(1,0,1,1), (1,1,0,1) 






3 


(0,1, 1,2), (2,1, 1,0) 





1 


4 


(1,0,2,1), (1,2,0,1) 





-1 



Denote by Ci the number of integers k G {n, n — 1, n — 1} for which the /th case occurs. Then 
we have 

^ Ci + Cs; -A- ^ C2 + C4. 
In order to prove Theorem [T] it is enough to show that 

Ci,C2^a; C3 ^ min{a + — a — C4 ^ min{/3 — a,p + a — (4) 

In fact, we will count values of instead of k (there is a bijection between the sets {n, n — 1, n — 
p + 1} and {a„, a„_i, a„_p+i}, because a^gr = k (mod p)). 

Note that a = mm{m,p — M}, where M and m are defined in Lemma Ei 

Case 1 

By lemma [3] we have M + m — p ^ Uk < m, so 

Ci ^ m — max{0, M + m — p} = min{m, p — M} = a. 

Case 2 

By Lemma [3l we have M ^ at < M + m, so 



Note that 
and 

We also put 7 



C2 ^ min{M + m,p} — M = min{m,p — M} = a. 
if M + m ^ p then a = p — M and (3 = p — m 



if M + m ^ p then a = m and p = M. 

+ 1 and remind that here k G {n, n — l,...,n — p+1}. 

In order to simplify the notation, we divide the third case into cases 3a and 36 and define Csa and 
C36 as above for the 4-tuples (0, 1, 1, 2) and (2, 1, 1, 0) respectively. Obviously, C3 = C^a + C'sb- 



Case 3a 

By Lemma [2] we have here < m, M, thus by Lemma [3] < M + m — p. By Lemma [H 



and 
Finally 



flfc < 7 

ttk - M - m + 2p = at-q-r ^ 7- 
max{7 + M + m — 2p, 0} ^ < min{7, M + m — p}. 
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and we obtain 

^ min{7, M + m — p} — max{7 + M + m — 2p, 0} 

= min{7, p — 'y,M + m — p,2p — M — m} 

^ min{M + m — p,2p — M — m} 

= m.m{a + P,p — a — P}, 

as long as M + m ^ p. Otherwise C^a = 0. 

Case 3b 

By Lemma [2] ^ m, M, so by Lemma [3] ^ M + m. By Lemma [1] 



and 

Finally 

Therefore 



ttk- M -m = ttk-q-r < 7 



max{7, M + m} ^ < min{p, 7 + M + m}. 



Csf, ^ min{]5, 7 + M + m} — max{7, M + m} 

= min{7, p — 'j,M + m,p — M~ m} 

^ min{M + m, p — M — m} 

= min{a + /?, p — a — 

as long as M + m ^ p. Otherwise C^i, = 0. 

Case 3 

Note that cases 3a and 3b are excluding each other. Thus C3 ^ min{a + f3,p — a — P}. 
Case 4 

Let us assume that q' = m and r' = M. By Lemma [2], we have m ^ ak < M (for Ffc_^ 
M ^ < m (when F^-r = 0). The second inequality is impossible, so 



0) or 



By Lemma [T] 
and 
Finally 
and 



Fk-q = and Fk_r = 2. 



ak-m = flfc.g < 7 
ak- M + p = ttk-r ^ 7- 
max{M + 7 — p, m} ^ < min{m + 7, M}, 



C4 ^ min{m + 7, M} — max{M + 7 — p, m} 

= min{7, p — ^,p — M + m,M — m} 

^ min{p — M + m, M — m} 

= mm{f] — a,p + a — (3}. 

That completes the verification of (jlj) and the proof of Theorem [H 



□ 
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4. The bound on A 

In this section we derive a bound on A = max{Aj^, —A^}. We also establish some infinite families 
of triples (p, q, r) with restrictions on q and r modulo p only, for which A is bounded by a constant 
independent of p, q, r. 

We also apply our bound on A to estimate the density of the set of ternary cyclotomic polynomials 
such that ^ ^ c, for any real c > 0. In view of Conjecture [21 the most interesting case is c = |. 
At the end we prove a weaker version of the old Belter's Conjecture. 

Proof of Theorem [H By Theorem [1], we have 

A ^ max{min{2Q; + f3,p — P},mm{p + 2a — (3, /?}}. 

li 13 <\p then 

A < max{min{2Q! + /?},/?} = min{2a + j3,p- [3} = min{2a + (3*,p- (3*}. 

Also ii (3 > \p then 

A ^ max{p - /3, min{p + 2q! - (3,(3}} = min{2a + p - /?, /9} = min{2a + P*,p- /?*}. 

□ 

Corollary 1. Let p > 3 and p = 2a+l = 36±l = 4c±l = 6(i±l for some integers a, h, c, d. If q 

is congruent to one of the numbers ±1, ±a, ±6, ±c, ±(i modulo p and also r is congruent to one of 
them modulo p, then A ^ 18. 

Proof. Observe that in all these cases a ^ /?* ^ 6. Then by Theorem [21 A ^ 2a + /?* ^ 18. □ 

Note that if both q and r are congruent to ±1 modulo p, then a = (3* = 1 and A ^ 3. 

Corollary 2. Let c > be a real number. Denote by D{c) the density of ternary cyclotomic polynomials 
for which — < c. Then 

„ . . _ r if < c < i; 

1-1(3 -4'c)^ ^S i^:c<|. 

Also D{c) = lifc^\. 

Proof. Let us denote by Pp^n{x,y) the probability that a = x and /?* = y, where q r are random 
primes from the set {p+l,p + 2, n} and a and P* are computed for the polynomial ^pqr- Dirichlet's 
Theorem says that the densities of primes in the arithmetical progressions l,p + l,2p + 1, 2,p + 
2, 2p + 2, p — 1, 2p — l,3p — 1, ... are the same. Then probabilities 

Pp{x,y) = lim Pp^nix,y) 

n— ►oo 

are equal for every integers 1 ^ x < y ^ it implies that if p ^ cxd then the distribution of (|, |) 

converges to the uniform distribution over the triangle T on the vertices (0, 0), (O, |), (|, |). 

Note that for random m e {l,2,...,n}, m = pqr, p < q,r, the expected value E„(p) — >• cxo when 
n — >■ oo. Then D{c) is not smaller than the area of some polygon divided by the area of the triangle 
T. Precisely, -D(c) ^ 8S{c), where S{c) is the area of the polygon defined by inequalities: 

11 , , 

< X < < y < x < y; c> min{2x + y,l — y}. 

The last inequality is due to Theorem [21 We can compute S{c) by simple summing the areas of some 
triangles. We obtain that 

r |c2, if 0<c<|; 

Sic)={ |-3^(3-4cf, if |^c<|; 
I I, if c^f. 
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This completes the proof of Corollary [2j □ 

We can apply our estimation of D{c) to check that Conjecture [2] is true for the set of ternary 
cyclotomic polynomials of density ^ p. The old Belter's Conjecture [T] holds for at least | of all the 
ternary cyclotomic polynomials. 

Although Conjecture [T]does not hold in general, we are able to prove a weaker version of it, with 
the same bound. Let A{p) denotes the average value of A of all the ternary cyclotomic polynomials 
with the smallest prime dividing n equal to p. 

Corollary 3. A{p) < £±i 

Proof. Let a{i,j) = min{2ajj- + f3*j,p — where aij and (3*^ are equal to a and /?* computed for 
the polynomial ^pgr with q' = i (mod p) and r' = i (mod p). Based on Theorem [21 using Dirichlet's 
Theorem as in the proof of Corollary [21 we obtain 



P-I P-I , (p-l)/2 (p-l)/2 

(^_i)2EE«(^'^') = (^ _^ 

' i=\ j=l ' 1=1 j=l 

Let k ^ be a nonnegative integer. Then 

^ ' p— 1 \ • fo- p—\ . p+1 



j=l ^ ' i=k 



^^a(z,iH A; j = min < 3z — fc H ,k — i + 



(p + l)k 

h 2^ mm{3z — k — 1, k — i\ 

(p+ l)fc 



It imphes that ^(p) ^ □ 



5. Proof of Theorem [3] 

First we present a simple expression for the difference of the two consecutive coefficients of a ternary 
cyclotomic polynomial in terms of Fj.: 



Lemma 6. Put 



and 



Then 



Moreover 



= Nii F F F F ) 
N = NJF F F F 1 

iv_ ivn^i n—pj ^ n—gi ^ n—ri ^ n—p—q—rj- 



apqr{n) - apgr{n - 1) = ^(iV_ - A^+). 



ttpqri^n^) Oipqrij^ 1) -^oi^Pn^ P-n—p—qi -^n—q—T i -^n—r—p) -^oi^-^n—pj -^n—qy -^n—ry -^n~p~q~r) 

■^2(^Fn, Fn—p—q, Fn—q—r^ -^n— i — p) -^2(-^n— pj F^—q, F^—ry Fn—p—q—r)- 
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Proof. By Lemma [5] 



apgr{n) - apgr{n - 1) = ^ (iVi(Ffc_g,Fj 



^ 7 t — ± 

-2 H {NiiFk-q, Fk^r) - N,{Fk, Fk-q-r)) 



k=n—p 



2 i.-^li.-^n—pi F'n—qi F^n—ri Fn—p—q—r^ -^l(-^ri) F^r 




n—r—p 



)) 



The remaining two equalities can be shown in the same way. 
Now we are ready to prove Theorem [31 By Lemma [6] we have 

\apqr{n) - apgr{n - 1)| = ^|iV- - A^+| ^ 2, 



□ 



where equahty may hold only if = 4, A^_|_ = or = 4, = 0. We will show that it is 
impossible. 

Indeed, for some permutation (t,u,v) of {p,q,r) by Lemma [HI we have F^-t = Fn-u £ {0,2} in 
case of {Fn, Fn-p-q, Fn-q-r; F^-r-p) = (1,1,1,1). Therefore |F„ - Fn-t - Fn-u + Fn-t-u\ = 2. Also 
if {Fn-p, Fn-g, Fn-r, Fn_p_g_r) = {^A-AA) then for some permutation (t,u,v) we have Fn-t-u = 
Fn-u-v £ {0,2} and \Fn-u — Fn-t-u — Fn-u-v — Fn-t-u-v\ = 2. Both cases contradict Lemma [31 This 
completes the proof of Theorem [31 □ 
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